Comparing multiple comparisons: practical guidance for choosing the best multiple comparisons test

Multiple Comparisons with the Best ROC Curve

The accuracy of a medical diagnostic tool depends on its specificity, the probability that it classifies a normal person as normal, and its sensitivity, the probability that it classifies a diseased person as diseased. The receiver operating characteristic (ROC) curve of such a tool is its sensitivity plotted against (1 specificity) as the threshold defining “normal” versus “diseased” ranges ov...

Multiple comparisons

While multiple testing procedures have been the focus of much statistical research, an important facet of the problem is how to deal with possible confounding. Procedures have been developed by authors in genetics and statistics. In this chapter, we relate these proposals. We propose two new multiple testing approaches within this framework. The first combines sensitivity analysis methods with ...

Multiple Comparisons with the Best, with Economic Applications

Multiple comparisons, explained.

The commentary by Savitz and Olshan (1) and the response by Thompson (2) form a fascinating contrast. Savitz and Olshan speak in the language of epidemiology, complaining about the seeming arbitrary and antiscientific dictates of conventional (frequentist) statistical methodology, particularly as it applies to the study of many associations. Thompson, speaking mainly in the language of statisti...

Multiple comparisons procedures.

In biomedical research, a common question posed by investigators is whether or not an outcome of interest differs significantly between multiple independent groups of subjects in the study sample. For example, in a randomized clinical trial focusing on differences in a parameter of cardiovascular health such as systolic blood pressure or heart rate that is measured on a continuum, one might mak...